Posts tagged Filecoin
Preloading a cache for a tiered storage system
- 19 January 2024
In this blog post, we explore the practical aspects of tiered storage systems, focusing on the nuances of hot and cold storage layers using different cache system strategies. The premise starts with the system’s initialization and an empty hot layer or cache and illustrate the impact of prepopulating a cache with randomly selected geospatial data. Specifically centered around landsat scenes within the continental US, the two layers—cold storage and hot storage (set up as a least recently used cache)—play key roles in the experiment. We’ll delve into the mechanics of data requests categorized as region, state, or county, and how the system strategically manages landsat scenes in the least recently used cache.
NDVI on Landsat 9 imagery with data using IPFS
- 30 August 2023
Geospatial professionals frequently handle vast data sets, like satellite imagery, for tasks ranging from object detection to land cover classification. The Normalized Difference Vegetation Index (NDVI) is a widely-used metric for assessing vegetation health in a given area. In this blog post, we’ll walk you through calculating NDVI using Landsat 9 imagery and the IPFS network with the help of the Python library, ipfs-stac, in a Jupyter notebook. We’ll also discuss the benefits of leveraging IPFS in geospatial workflows, such as content-addressing and decentralization.
Proof of Concept Workflow Atomization Demo
- 01 July 2023
With a couple of use cases of code atomization now defined (shown in the previous post), this article will present a proof of concept for atomizing a simple Python workflow and generating a manifest of CIDs for the components used.
Decentralized and Deconstructed Approach to Code Artifacts
- 30 June 2023
For scientific publishing, being able to share artifacts such as data and code is imperative to illustrate a methodology in practice and support the validity of findings through replicability.
John Solly's Talk at CoD Summit
- 27 June 2023
Watch John Solly, the Lead Geospatial Developer at the EASIER Data Initiative present at the Compute Over Data Summit in Boston, Massachusetts. His talk will explore the importance of satellite imagery and other geospatial data and how decentralized technologies have opened opportunities to the workflows with such data.
FIL Network Base Austin 23 Lightning Talk
- 12 June 2023
Watch John Solly, the Lead Geospatial Developer at the EASIER Data Initiative present his lightning talk at the FIL Network Base in Austin Texas. His talk will explore use cases for Filecoin and IPFS being utilized to store publicly funded geospatial data to promote accessibility for research and academic institutions.
Seamlessly Fetching Files from IPFS － A Proof of Concept for Building a Flexible Local Client
- 24 April 2023
As decentralized web technology continues to develop, the InterPlanetary File System (IPFS) offers an alternative approach to distributed file storage and sharing. In this notebook, we will present a proof of concept for building a flexible local client capable of fetching files from IPFS, regardless of whether the user has a local IPFS node or not. We will also discuss the advantages of using a local IPFS node over relying on public gateways, and showcase how to implement a fallback mechanism for maintaining uninterrupted access to IPFS content.
A New Way to Reference and Retrieve Geographic Data
- 02 December 2022
Web3 is an exciting and rapidly evolving space for geographic information. This post explores how EASIER uses STAC, Filecoin, and IPFS to store, retrieve, and analyze geospatial data.
The EASIER Data Initiative Launch
- 09 September 2022
We are thrilled to announce the EASIER Data Initiative, a @umdgeography, and @FFDWeb collaboration. We make it easier to upload and retrieve geospatial data from decentralized storage systems including #Filecoin and #IPFS.