Filecoin programs and tools

This page covers the various programs and services that storage providers can take part in.

Although it is possible to find your own data storage customers with valuable datasets they want to store, and have them verified through KYC (Know Your Customer) to create verified deals for Fil+, there are also programs and platforms that make it easier for storage providers to receive verified deals.

Web3.storage runs on “Elastic IPFS” as the inbound storage protocol offering scalability, performance and reliability as the platform grows. It guarantees the user (typically developers) that the platform will always serve your data when you need it. In the backend the data is uploaded onto the Filecoin Network for long-term storage.

Filecoin Green aims to measure the environmental impacts of Filecoin and verifiably drive them below zero, building infrastructure along the way that allows anyone to make transparent and substantive environmental claims. The team maintains the Filecoin Energy Dashboard and works with storage providers to decarbonize their operations through the Energy Validation Process. Connect with the team on Slack at #fil-green, or via email at green@filecoin.org.

Spade automates the process of renewing storage deals on the Filecoin network, ensuring the longevity of data stored on the blockchain. This is particularly useful for datasets that need to be preserved for extended periods, far beyond the standard deal duration. By using Spade, organizations and individuals can manage and maintain their data storage deals more efficiently, guaranteeing that valuable data remains accessible and secure over time.

Singularity is an end-to-end solution for onboarding datasets to Filecoin storage providers, supporting PiB-scale data. It offers modular compatibility with various data preparation and deal-making tools, allowing efficient processing from local or remote storage. Singularity integrates with over 40 storage solutions and introduces inline preparation, which links CAR files to their original data sources, preserving dataset hierarchies. It also supports content distribution and retrieval through multiple protocols and provides push and pull modes for deal making along with robust wallet management features.

Partner tools and programs

Many other programs and tools exist in the Filecoin community, developed by partners or storage providers. We list some examples below.

CIDGravity is a software-as-a-service that allows storage providers to handle dynamic pricing and client management towards your solution. It integrates with deal engines such as Boost.

Swan is a provider of cross-chain cloud computing solutions. Developers can use its suite of tools to access resources across multiple chains.

Swan Cloud provides decentralized cloud computing solutions for Web3 projects by integrating storage, computing, and payment into one suite.

Open Panda was a platform for data researchers, analysts, students, and enthusiasts to interact with the largest open datasets in the world. Data available through the platform was stored on Filecoin, a decentralized storage network comprised of thousands of independent Storage Providers around the world.

Former programs and tools

Here is a comprehensive list of deprecated tools and projects.

Evergreen

Maintenance status

Evergreen extended the Slingshot program by aiming to store open datasets forever. Standard deals had a maximum duration of 540 days, which was not long enough for valuable, open datasets that might need to be stored forever. Evergreen used the Spade deal engine, which automatically renewed deals to extend the lifetime of the dataset on-chain.

CO2.Storage

Maintenance Status

CO2.Storage was a decentralized storage solution for structured data based on content-addressed data schemas. CO2.Storage primarily focused on structured data for environmental assets, such as Renewable Energy Credits, Carbon Offsets, and geospatial datasets, and mapped inputs to base data schemas (IPLD DAGs) for off-chain data (like metadata, images, attestation documents, and other assets) to promote the development of standard data schemas for environmental assets. This project was in alpha, and while many features could be considered stable, it was waiting until being feature complete to fully launch. The Filecoin Green team was actively working on this project and welcomed contributions from the community.

Filecoin Tracker (filecoin-tracker.com)

Maintenance status

Filecoin Tracker was deprecated on April 20, 2024.

Here are great existing and working Filecoin dashboards that cover similar topics:

Slingshot (slingshot.filecoin.io)

Slingshot was a program that united Data clients, Data preparers and storage providers in a community to onboard data and share replicas of publicly valuable Open Datasets. Rather than providing a web interface like Estuary, Slingshot was a program that provides a workflow and tools for onboarding of large open datasets. The Slingshot Deal Engine provided deals to registered and certified storage providers. The data was prepared and uploaded using a tool called Singularity.

Dataprograms.org (dataprograms.org)

Maintenance status

dataprograms.org listed tools, products, and incentive programs designed to drive growth and make data storage on Filecoin more accessible. It was discontinued in April 2024.

Moonlanding

Maintenance status

Moon Landing was designed to ramp up storage providers in the Filecoin network by enabling them to serve verified deals at scale.

Filecoin Dataset Explorer (datasets.filecoin.io)

Maintenance status

Filecoin Dataset Explorer showcased data stored on the Filecoin network between 2020 and 2022, including telemetry, historical archives, Creative Commons media, entertainment archives, scientific research, and machine learning datasets. It highlighted Filecoin's capability to store large datasets redundantly, ensuring availability from multiple Storage Providers worldwide. Each dataset is identified by a unique content identifier (CID). The platform aimed to make diverse datasets accessible to users globally.

See also: Legacy Explorer (legacy.datasets.filecoin.io)

Estuary (estuary.tech)

Maintenance status

Estuary was an open-source software designed for sending public data to the Filecoin network, facilitating data retrieval from anywhere. It integrated IPFS and Filecoin technologies to provide a seamless end-to-end example for data storage and retrieval. When a file was uploaded, Estuary immediately made multiple storage deals with different providers to ensure redundancy and security. The software automated many aspects of deal making and retrieval, offering tools for managing connections, block storage, and deal tracking. Estuary aimed to simplify the use of decentralized storage networks for developers and users.

Estuary was discontinued in July 2023, and the website shut down in April 2024.

Big Data Exchange

Maintenance status

Big Data Exchange was a program that allowed storage providers easy access to Filecoin+ deals through an auction where Storage Providers could bid on datasets by offering to pay clients FIL to choose the bidder as their Storage Provider.

Last updated