x3o Posted December 11 Posted December 11 Support is telling me that i shouldn't request data longer than 6 months. This is obviously useless. Everybody wants long term data. Pls put the whole archive online through torrents. https://academictorrents.com/ Like so.
Neil Davis Posted December 12 Posted December 12 Thank you for your suggestion, we have not seen academic torrents before. However, I am not sure that it would be a good set for the New European Wind Atlas dataset. Our dataset would almost double the amount of data available via that platform. It is also unclear to me how users would be able to subset the data so they could get what they are interested in and not the full dataset. We are almost finished repackaging the data into a format that should allow users to download around 10 years of data for a single point. We are doing performance testing to determine the new limits for this repackaged data. It should launch early next year.
x3o Posted December 12 Author Posted December 12 You could split the timeseries data into geographical tiles. Torrenting is a very good way to share big files too.
x3o Posted December 12 Author Posted December 12 Let's say you have 100TB of data. You split it into 1000 geographical tiles and then compress it and put it into a torrent. Downloading 10GB is manageable on todays broadband connections.
Neil Davis Posted December 13 Posted December 13 Sure, everything is possible. I have reached out to via DM to see if this is something we could collaborate on.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now