ControlCiudadanoPy.org is a transparency portal that unifies various open data sources and provides an interactive portal to explore data about authorities, public employees, and public tenders.
The portal is open source (
https://github.com/InstIDEA/controlciudadano/).
We use a myriad of open source projects to automatize the recollection of data and make this process as transparent and repeatable as possible. In the ETL part, we use Apache Airflow, and in the frontend, we use React with various libraries.
Tools:
- Data pipelines with airflow, pentaho, tabula, postgres and others
- Data standards like OCDS
- Web portal build with react, an API with express and redash
- CI/CD with docker, github actions and other services like traefik