Gapminder

Logo-Valor-default@2x
Valor Software
  • Score Awaiting client review
    n/a
  • Date Published
  • Reading Time 2-Minute Read
5c4f15733485392d0ccc25c6_gapminder

The complete and production-ready the website that acts a single place for other parts of the project.

Project Description

Gapminder Offline is an offline implementation of Vizabi – a framework for building visual data exploration tools freely provided by Gapminder. 
Waffle Server is a huge bank of public statistical data which supports its versioning. The sources could be the files or other structures corresponding to the rules described in the DDF (Data Definition Format). DDF is a conceptual model or a system to organize data and to define how pieces of data relate to each other.
WaffleServer is able to handle complex queries through its own DDFQL (DDF Query Language).

Tasks

  • Vizabi integration, readers (DDF-CSV, Excel, CSV) integration;
  • Data management (including chart state saving and restoring, chart state export to a different format);
  • Support for UI Controls & Interaction;
  • Translation & Localization;
  • The ability to work with a number of charts at the same time;
  • The possibility to work on Windows, Linux and Mac OS;
  • An automatic update system;
  • Processing huge CSV databases in seconds;
  • Analytical visualization tools;
  • Data-versioning support;

Solutions

  • Test Driven Development (e2e tests);
  • DDF-CSV databases to store all data;
  • Electron framework that provides an offline version of the application;
  • DDFCSVreader for DDF data reading
  • WS reader for querying data on WS by DDFQL
  • GitHub integration
  • GCP integration
  • containerization strategy with Docker

Outcome

  • Offline visualization tool for statistic data.
  • Highly effective data versioning engine that can operate hundreds of gigabytes of data.

Technology

  • Node.js → Typescript
  • Express
  • Lodash
  • bunyan
  • mongoose
  • Mocha/Chai/Sinon
  • MongoDB
  • Redis
  • New Relic
  • AWS (EC2, ECR, ECS, ElasticCache, CloudFormation) → GCP
  • Electron

View Online