<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1099981018;
mso-list-type:hybrid;
mso-list-template-ids:-1370973356 -1726204838 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:-;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Calibri",sans-serif;
mso-fareast-font-family:Calibri;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head><body lang="EN-US" link="blue" vlink="purple"><div dir="auto">FWIW, I had no trouble capturing 4 x 384 kHz slices with HDF5 on an older i7 laptop with SSD.</div>
<div class="gmail_quote" >On May 28, 2019, at 10:58 AM, "Engelke, Bill via TangerineSDR" <<a href="mailto:tangerinesdr@lists.tapr.org" target="_blank">tangerinesdr@lists.tapr.org</a>> wrote:<blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Tom – let’s talk more about the throughput issue. As I mentioned before, I am working right now on a way to do some benchmarking to start gauging what is possible.
I have a related question for you:</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"></span></p><p> </p><p></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo1"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">-<span style="font:7.0pt "Times New Roman"">
</span></span></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">On your quad core I7, have you narrowed down where the bottleneck is? There have been some discussions that a rotating hard drive might not be able
to keep up with the data rate, no matter what format is used. (Something else I am going to test). It is quite possible that the compute time to put the data out as HDF5 might be the smaller part of the time budget, and disk writing the larger.</span></p><p></p><p></p>
<p class="MsoListParagraph" style="text-indent:-.25in;mso-list:l0 level1 lfo1"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"><span style="mso-list:Ignore">-<span style="font:7.0pt "Times New Roman"">
</span></span></span><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">At today’s prices, a 2 TB or 4 TB SSD is a budget buster, but this might not be the case in 2024.</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"></span></p><p> </p><p></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D">Any thoughts?</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"> I am building a crude prototype to see if I can save
multiple channels off a Red Pitaya using HDF5 (Digital RF actually, but it uses HDF5), and compare throughput using both spinning drive on USB3 and SSD. -73- Bill</span></p><p></p><p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D"></span></p><p> </p><p></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Tom McDermott <tom.n5eg@gmail.com>
<br>
<b>Sent:</b> Sunday, May 26, 2019 9:08 PM<br>
<b>To:</b> TAPR TangerineSDR Modular Software Defined Radio <tangerinesdr@lists.tapr.org><br>
<b>Cc:</b> Scotty Cowling <scotty@tonks.com>; Engelke, Bill <bill.engelke@ua.edu><br>
<b>Subject:</b> Re: [TangerineSDR] Functional Specification v 0.3</span></p><p></p><p></p>
<p class="MsoNormal"></p><p> </p>
<div>
<div>
<div>
<p class="MsoNormal">Hi Bill - thanks for iterating the specification. Here are a few comments on 0.3:</p><p></p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
<div>
<p class="MsoNormal">There are no paragraph numbers to reference, and the page numbers may change</p><p></p>
</div>
<div>
<p class="MsoNormal">depending on how mark-up is selected by the reader, so I'll reference the Title of the paragraph.</p><p></p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
<div>
<p class="MsoNormal">General Requirements - Assumptions and Dependencies:</p><p></p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
<div>
<p class="MsoNormal">1. The HD may be able to be reduced to 2TB if the 20GE snapshot<br>
can be made while recording to the ring buffer. 2T SSD drives<br>
are coming down in price faster than 4T.</p><p></p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
<div>
<p class="MsoNormal">Technical Notes</p><p></p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
<div>
<p class="MsoNormal">I am skeptical that a SBC-based host can run HDF5 and keep up<br>
with the received data. My quad Core I7-3740 3.4 GHz can not </p><p></p>
</div>
<div>
<p class="MsoNormal">keep up with 4 x 192k from one antenna (one fourth the DE</p><p></p>
</div>
<div>
<p class="MsoNormal">requested throughput). It may be better to run HDF5 only on the</p><p></p>
</div>
<div>
<p class="MsoNormal">snapshot that is uploaded to the Central Server. That way it</p><p></p>
</div>
<div>
<p class="MsoNormal">doesn't have to run at real-time speed, it only needs to code a small</p><p></p>
</div>
<div>
<p class="MsoNormal">subset of the data and can run at a much slower rate paced by how</p><p></p>
</div>
<div>
<p class="MsoNormal">fast the upload link is.</p><p></p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
<div>
<p class="MsoNormal">Data format. The DE will downconvert and decimate the received
<br>
samples. This will produce 24 bit I and 24 bit Q samples, probably 2's<br>
complement binary. These will need to be converted to single<br>
precision floating point I and floating point Q prior to HDF5 encoding.</p><p></p>
</div>
<div>
<p class="MsoNormal"><br>
-- Tom, N5EG</p><p></p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
<div>
<p class="MsoNormal"></p><p> </p>
</div>
</div>
</div>
<p class="MsoNormal"></p><p> </p>
<div>
<div>
<p class="MsoNormal">On Fri, May 24, 2019 at 12:40 PM Engelke, Bill via TangerineSDR <<a href="mailto:tangerinesdr@lists.tapr.org">tangerinesdr@lists.tapr.org</a>> wrote:</p><p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Scotty - Please see attached, updated to include some of the things discussed at Dayton. Next I will work on the Functional Specifications for the Central Control & Database system.</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">If anyone would like me to start posting to the TAPR github or somewhere, please just text credentials to my mobile number, below. I can assure everyone that I will not make a
mess of it, having done this before.</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">W. D. Engelke (Bill), Asst. Research Engr.</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Center for Advanced Public Safety</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Cyber Hall</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">The University of Alabama</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Tuscaloosa, AL 35487</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Desk: (205) 348-7244</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Mobile: (205) 764-3099</p><p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> </p><p></p>
</div>
</div>
<p class="MsoNormal">-- <br>
TangerineSDR mailing list<br>
<a href="mailto:TangerineSDR@lists.tapr.org" target="_blank">TangerineSDR@lists.tapr.org</a><br>
<a href="http://lists.tapr.org/mailman/listinfo/tangerinesdr_lists.tapr.org" target="_blank">http://lists.tapr.org/mailman/listinfo/tangerinesdr_lists.tapr.org</a></p><p></p>
</blockquote>
</div>
</div>
<pre class="blue">-- <br>TangerineSDR mailing list<br>TangerineSDR@lists.tapr.org<br><a href="http://lists.tapr.org/mailman/listinfo/tangerinesdr_lists.tapr.org">http://lists.tapr.org/mailman/listinfo/tangerinesdr_lists.tapr.org</a><br></pre></blockquote></div></body></html>