We have a distributed sensor network (12 nodes), using Ethernet as the backend protocol. These are networked at 100Mb/s to a single 1Gb/s link using a 16-port switch.
I’ve previously seen Java and C code to listen to a port. However our aim is to get data into the hard drive ASAP. The nodes will be transmitting with >50% network utilization meaning the Gb/s link will have a very high utilization. The data throughput will be too high to put into local RAM without issues write-read management.
My question is, what issues do I need to access when piping data as fast as possible to a hard drive. We are a single remit, that of real time data acquisition. Therefore filling RAM and later dump to HD with a gap in data acquisition is unacceptable.
Thanks.