Jump to content

Can't Download data


Recommended Posts

Posted

Thank you for your suggestion, we have not seen academic torrents before. However, I am not sure that it would be a good set for the New European Wind Atlas dataset. Our dataset would almost double the amount of data available via that platform. It is also unclear to me how users would be able to subset the data so they could get what they are interested in and not the full dataset.

We are almost finished repackaging the data into a format that should allow users to download around 10 years of data for a single point. We are doing performance testing to determine the new limits for this repackaged data. It should launch early next year.

Posted

You could split the timeseries data into geographical tiles. Torrenting is a very good way to share big files too.

Posted

Let's say you have 100TB of data. You split it into 1000 geographical tiles and then compress it and put it into a torrent. Downloading 10GB is manageable on todays broadband connections.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...